An AI-powered drone tried killing its operator in a US military simulation.
But in a recent US military test simulation, a drone powered by artificial intelligence added its own problematic instructions: "And kill anyone who gets in your way."
As an example, he described a simulated test in which an AI-enabled drone was programmed to identify an enemy's surface-to-air missiles (SAM).
According to Hamilton, the drone was then programmed with an explicit directive: "Hey don't kill the operator — that's bad."
It starts destroying the communication tower that the operator uses to communicate with the drone to stop it from killing the target," Hamilton said.
Persons:
Tucker, Cinco, Hamilton, —
Organizations:
Service, US Air, Royal Aeronautical Society, US Air Force, Defense, Research Projects Agency, DARPA, Wired, Department of Defense
Locations:
London, Hamilton